The statistics of critical points of Gaussian fields on large-dimensional spaces 
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We calculate the average number of critical points of a Gaussian field on a high-dimensional space 
as a function of their energy and their index. Our results give a complete picture of the organization 
of critical points and are of relevance to glassy and disordered systems and landscape scenarios 
coming from the anthropic approach to string theory. 
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The statistics of random fields have been studied in de- 
tail in the mathematics and physics literature Gaus- 
sian random fields are of particular importance, as they 
can be argued to occur spontaneously in systems with a 
large number of degrees of freedom by appealing to the 
central limit theorem. Recently string theorists have pos- 
tulated that the effective theory arising from string the- 
ory is highly complex leading to a string landscape with a 
huge number of possible minima, each of which could de- 
scribe a potential universe , thus a statistical study of 
this complex landscape may well be necessary. Gaussian 
fields arise generically in the study of classical complex 
systems such as spin glasses, optimization problems and 
protein folding 3J. In many of these systems, jamming or 
the onset of a glass transition occurs due to the presence 
of a large number of metastable states or local minima 
in the energy landscape. High-dimensional complex po- 
tentials also occur as the potential energy of interacting 
particle systems which exhibit a structural glass tran- 
sition (no quenched disorder is present). Many numer- 
ical results exist on these potential energy landscapes, 
notably for Lennard- Jones and soft-sphere glass forming 
mixtures Q. Scaling arguments relating the number of 
critical points (points where the gradient of the potential 
energy vanishes) of various types also exist [5j and the 
onset of the glass transition is often identified with the 
point where the critical points in the free energy land- 
scape become dominated by minima jfjj. In this Letter 
we compute the average number of critical points of a 
Gaussian potential, on a high dimensional space, at fixed 
value of the potential and at fixed number of negative 
eigenvalues at the critical point. 

We shall consider a Gaussian field <f> defined over vol- 
ume V of an iV-dimensional Euclidean space. The field 
has zero mean and correlation function: 
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This scaling in N ensures the existence of the thermo- 
dynamic limit (as N — > oo) of what is known as the 
toy model, whose statics and dynamics || have been 
studied in the literature. The version of the toy model 



corresponding to our study here is a single particle in the 
potential V(x) = 0(x). In the harmonically confined ver- 
sion of the toy model the potential energy of the particle 
is V(x) — 4>(x) + 5/ix 2 , and the presence of the confining 
potential means that the volume V of the system can be 
taken to infinity. The total number of critical points for 
the toy model with confining potential was studied by Fy- 
odorov |9( as a function of fi. Here we study the case with- 
out confining potential in a finite volume. We give ex- 
plicit expressions for the average of the number, J\f(a, e), 
of critical points as a function of index Na and their en- 
ergy Ne in the form (Af(ct, e)) ~ exp[jVS(o!, e)], where 
E(e, a) is the "complexity", thereby giving a complete 
picture of the geometry of critical points. Our method 
can also be applied to the confined case where /1 7^ 
and details will be published elsewhere [Hj . For the pur- 
poses of this paper we consider the unconfined case as 
it is more relevant to landscape scenarios in string the- 
ory and other translationally invariant systems and also 
because the results are more explicit. 

For an N x N matrix H the index of H, denoted by 
1{H ) , is defined as the number of negative eigenvalues of 
H. The number of critical points of energy E = Ne and 
index aN is given by the generalized Kac-Rice formula 
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N 



dx Y[5 (di(f>(-x)) |detff(x) 



S((f>(x)-Ne)S(l(H(x))-Na) ) (2) 



where H(x) is the Hessian matrix of the field 4> at the 
point x, with elements ify(x) = didj(f>(x). The average 
of A/"(cv, e) is then given, using the spatial translational 
invariance of the field d>, as 



N 



(JV(a,e)> = K<(n*W(0)))|det(F(0)|*(^(0)-JVe)) 



i=l 



5(1(H(0))-Na)). 



(3) 



The non- vanishing correlation functions for the Gaussian 



2 



random variables H (0) and (f)(0) are: 



(0(0) 0(0)) 
(didj(f)(0) d k di4>{Q)) 
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(SikSij + SijSik + SkjSu) 



(9,9,0(0) 0(0)) = <%/'(0). 
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Note that positivity conditions for the correlation func- 
tion of a Gaussian field in Fourier space can be shown to 
imply 10] /(0) > 0, /'(0) < and /"(0) > 0. When / is 
an analytic function at the origin it is easy to show that 
the variables 9^0(0) are independent of H (0) and 0(0), as 
their correlation with these variables is identically zero. 
The averaging in Eq. can thus be factorized to give 

N 

{N (a, e))=V ([{5(8^(0))) x 

i=l 

(| det(ff(0)|5 (0(0) - Ne))5 (1(H(0)) - Not)). (5) 
Putting this together yields 

V 



(Af(ot,e)) = 



(2n\f'(0)\Y 



(6) 



where 



Q(a,e) = J d4>Y[dH i:j p(H,Ne)\det(H)\S (1{H) - Not) . 

(7) 

Here p(H, 0) is the joint probability density of H and 
(we have dropped the argument 0) . From the correlators 
in Eq. J3J it can be shown that 

p{H,<j>) = C N exv(-N 2 S 2 (H)-NS l (H,<f>)) (8) 

where (7/v is a normalization constant and the dominant 
term of the action 82(H) is given by 



S 2 (H) = 



1 



4iV/"(0) 



TriJ 2 - — (TtH) 
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and the sub-dominant term S\ (0, H ) is given by 



Si(H,, 



where 
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Positivity conditions for Gaussian correlators can be used 
to show that Q > for N finite [10(. However it is pos- 



sible that Q* 



W is zero. A 



+00 ^ ~ f"(o) _ f(f _ 
case, often used in simulations of diffusion in random 

media where this occurs is for f(x) — exp(— x/l 2 ), 



where I is the correlation length . In this case the action 
Si is order N and some modifications of our approach 
are needed. For the moment we will proceed by exam- 
ining the case Q* ^ 0. We remark that as the field 
is statistically isotropic we see that the actions S2 and 
Si are invariant under the action of the rotation group 
O(N) and that the associated measure thus describes a 
Gaussian Orthogonal Ensemble (GOE). Notice that if we 
integrate over the field we find the marginal distribu- 
tion for H, p rn (H), is given by 



p m (H) = C^exp 



N 



4/"(0) 



TtH 



1 



N 



(TrHy 



(12) 

where C' N is a normalization constant and recovers the 
result of Fyodorov |9|. Note that in the above one can 
take the limit Q* — without any problems. 

We now apply the standard result for the GOE where 
the integral over H can be reduced to an integral over its 
eigenvalues [l2(: 

N 

p(H, 0) H dHij - C^p(K, o J [ A A J J dX h (13) 

i<j i<j i—1 

where C 1 ^ is a normalization constant. The key step is 
now to introduce the normalized density of eigenvalues 
defined as 



1 N 



(14) 



We now adopt the constrained Coulomb gas approach 
recently introduced in Il3j and using standard methods 
of functional integration [10| we may write 



n(a,e) 



e(a,e) 
D 



(15) 



where 



0(a,e) = / d[p}cxp(-N 2 S 2 (p) - NSi(p,e)) 



d\p(X) -a) 6 



d\p(X) - 1 . (16) 



The key point and major simplification in Eq. (|16fl is that 
the constraint on the index becomes a simple integral 
constraint on the functional p. The effective actions in 
Eq. (jT1)|> are given by 



S 2 (p) 



4/"(0) 



dXX 2 p(X) 



dXXp(X) 



- - I dXdX'p(X) P (X')ln(\X-X'\) 



(17) 



3 



and 



S 1 (p,a,e) = J dAp(A)(ln(p(A))-]n(|A|)) 
1 lN + 2 e>-2me[dXX P (X) 



+ 



2Q/"(0) 

/(O) 
/"(O) 



iV 



dXXp(X) 



/"(O) 



(18) 



The term 13 in l|15|l is a normalization factor given by 



£> = /"eZ[p]e X p(-A^ 2 [p]-ArS((p)) 



(19) 



with 



S[(P) = 



1 AT 
2/"(0) iV + 2 



dXXp(X) j + J dXp(X)lnp(X). 

(20) 

The above functional integrals can be evaluated by 
saddle-point. The order N 2 action 52 has a zero mode 
as it is independent of the average of the eigenvalues, 



A = / dXXp(X). 



(21) 



Note that in the usual Gaussian ensembles the second 
term of 5 2 is absent, thus if the average value of the 
eigenvalues is shifted from zero (and thus we shall see 
later the value of a is shifted from 1/2) then the con- 
straint increases the action iS 2 by a finite value and thus 
the probability of finding a Gaussian matrix with a / 1/2 
is of order exp(— N 2 0(a)) making the probability of min- 
ima for instance extremely small jl.'A Il4l Il5| . This is not 
the case for the Hessian of a Gaussian random field at 
a critical point due to the presence of this zero mode. 
The degeneracy of the zero mode is however lifted by the 
order N action. The value of p minimizing the action 
1S2 is given by a Wigner semi-circle |l6j ] law up to an 
undetermined shift (the zero mode) 



Psc{X) 



1 



2\ 2 



2tt/"(0) 



(4/"(0)-(A-A) 2 ) 



(22) 



which has support A G [A - 2 v //"(0), X + 2^// 77 (0)] . This 
distribution is stiff and any departure from its form will 
reduce the number of critical points with index fixed to be 
non-zero by a factor exp(— N 2 9(a)) (with possible log (A 7 ") 
corrections to the prefactor A^ 2 in the case where a is not 
strictly equal to one or zero 

Consequently the order N 2 terms in the saddle-point 
expressions for O and D cancel as does the order N en- 
tropy term J dXp(X) In (p(A)), which is clearly indepen- 
dent of A. In addition the saddle-point of D is clearly at 
A = 0. We thus find, that to leading order, the complex- 



ity of critical points is given by 

In (Af(a, e)) 



£(ar,e) 
1 



N 



2/"(0)Q 
2 \2ne\f'(0)\ 



2 / ' (0) A £ + 1 PA 2 



(23) 



where we have made use of the result 
dAp sc (A)ln(|A|) 



i ^ + i(-l + M/"(0))),(24) 



valid in the regime of interest, |A| < 2y/ f"(Q), and have 
defined 



P = 



fW 
/"(o) s 



f (0) 2 , /(0) 



/"(0) 2 noy 



(25) 



In addition, the volume V of the system is written as 
V = L , with L its characteristic length. The value of A 
is determined from the index constraint 



dXp sc (X) 



dy(l-y 2 y=a. (26) 



We now discuss the consequences of this general result. 
If we only constrain the energy of the critical points we 
find a complexity 



2 ^27re|/'(0)| 



(27) 



2/"(0)P 

and the most probable value of a can be computed via 

, /'(0)e 



A(e) 



7"(o)p' 



(28) 



and then using the relation Eq. (|26|) . We remark that, 
as /'(0) < 0, then as e decreases A increases meaning 
that the most probable index a decreases. Also for A > 
2\//"(0) the value of a freezes at a — 0, meaning that 
all the eigenvalues are positive and thus the typical crit- 
ical points below a critical energy e c = (/"(0)) 5 P//'(0) 
are minima. If only the index of the critical point is con- 
strained then we find that 



E(a) 



A 2 



4/"(0) 



2 \2ne\f'(0)\ 



(29) 



and that the most probable energy at a given value of a 
(equivalently A) is 



6(A) 



f(0) 
/"(0) 



A. 



(30) 



From this we see that the most probable energy of min- 
ima, e m , is e m = 2f'(0)/y/ /"(0). In fact one can show 
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that e m > e c with equality in the case Q* = [lo|. This 
means that generically most minima are at the energy 
e m but it is only below the energy e c that they are the 
dominant critical points. For A > 2^J /"(0) all critical 
points are minima, so the complexity of minima is 



1 / r(o)L 2 

2 n ^2^ e |/'(0)| 



(31) 



Thus there is a characteristic length L c = 
\J 27re 3 1/'(0)|//"(0) below which there are almost 
surely no minima. 

We now discuss the case where Q* = 0. In this case 
the first line of Eq. Ijl8(l is of order one but the other 
terms are of order N. We see, however, that the order 
N terms only depend on p via A. This means that at 
the saddle-point p still has the Wigner form of Eq (1221 . 
Consequently we find that 



E(a, e) 



N 



N + 2 2 
4/(0) L N 

2 V.2H/'(0)| 



2 7W) Xe+ 2 PX . 



(32) 



where we have kept the iV-dependent prefactor of e 2 . 
Completing the square in e, the above result may be writ- 
ten to leading order for large N as 



E(a,e) 



N 



4/(0) 



f(0) - 

f"(oy 



A 2 



4/"(0) 



2 ^27re|/'(0)| 



(33) 



which means that when the index is fixed (i.e. A is fixed) 
then the critical points of index given by A are concen- 
trated about the energy e = A/'(0)//"(0) as before but 
the fluctuations about this energy are 0(1/ N) as opposed 
to fluctuations of 0(1/ yN) in the case where Q* ^ 0. 
The same scaling holds for the fluctuations about the 
most probable index, given by Eq. Q28|). when the en- 
ergy is fixed. 

A study of the p-spin spherical spin glass model ^3 has 
shown that at energies below a threshold energy almost 
all critical points are minima. However, at the thresh- 
old energy all indices are equally probable. In the model 
studied here there is a similar threshold energy below 
which almost all critical points are minima. However, as 
this energy is increased the index is concentrated around 
a well defined value up to an upper threshold energy be- 
yond which all critical points are maxima. 

Numerical investigations of the critical points of glass 
formers Q are carried out by equilibrating the system, 
freezing it and then finding nearby critical points. In 
most of these studies a clear linear relation is found be- 
tween the index a and the potential energy e for values 
of a between and about 0.1. This is in contrast to the 



results found here where a linear relation exists between 
A and e, and the relation between a and e must be found 
via Eq. H26JI . For small a we find the relation 



4V2 
~3tT 



(34) 



This difference may be due to the fact that the Gaussian 
landscape is quite different from that of glass formers. 
However, it may also be that the preparation of the sys- 
tem in an equilibrium configuration, before starting the 
critical point search, biases the statistics of the critical 
points found, whereas our calculation is based on a purely 
flat measure. 

In summary, we have provided a complete description 
of the distribution of critical points of Gaussian fields in 
high-dimensional spaces, as a function of their energy and 
index. The generalization to the case of a confining har- 
monic potential will be presented elsewhere ^} • Finally 
the analytic results presented here will also be useful to 
test numerical methods used to explore the critical points 
of potentials on large-dimensional spaces. 
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